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Abstract 



We consider a particle system on Z d with finite state space and interactions of 
' infinite range. Assuming that the rate of change is continuous and decays sufficiently 

p I , fast, we introduce a perfect simulation algorithm for the stationary process. The 

basic tool we use is a representation of the infinite range change rates as a mixture 
of finite range change rates. The perfect simulation scheme provides the basis for the 
construction of a finitary coding from an i.i.d. finite-value process to the invariant 
measure of the multicolor system. 
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oo ' 1 Introduction 

O ' 

In this paper we first present a perfect simulation algorithm for a multicolor system on 
7L d with interactions of infinite range. This perfect simulation algorithm is the basis of 
the construction of a finitary coding from a finite-valued i.i.d. process to the invariant 
probability measure of the multicolor system. 

By a perfect simulation algorithm we mean a simulation which samples precisely from the 
stationary law of the process. More precisely, for any finite set of sites F and any finite 
time interval [0, t] we want to sample the stationary time evolution of the coloring of sites 
in F during [0,t]. 

By coding we mean a translation invariant deterministic measurable map from the finite- 
valued i.i.d. process to the invariant probability measure of the system. Finitary means 
that the value of the map at the origin depends only on a finite subset of the random 
variables. This finite subset is a function of the realization of the family of independent 
random variables. 

The process we consider is an interacting particle system with finite state space. The 
elements of this finite state space are called colors. To each site in Z rf is assigned a color. 
The coloring of the sites changes as time goes by. The rate at which the color of a fixed 
site i changes from a color a to a new color b is a function of the entire configuration and 
depends on b. 
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We do not assume that the system has a dual, or is attractive, or monotone in any sense. 
Our system is not even spatially homogeneous. The basic assumptions are the continuity 
of the infinite range change rates together with a fast decay of the long range influence 
on the change rate. These two properties imply that the change rates can be represented 
as a countable mixture of local change rates of increasing range. This decomposition 
(see Theorem Q]) extends to the case of interacting particle systems the notion of random 
Markov chains appearing explicitly in Kalikow (1990) and Bramson and Kalikow (1993) 
and implicitly in Ferrari et al. (2000) and Comets et al. (2002). 

The decomposition of the change rate of infinite range as a countable mixture of finite range 
change rates suggests the construction of any cylindrical time evolution of the stationary 
process by the concatenation of two basic algorithms. First we construct a backward black 
and white sketch of the process. Then in a second forward algorithm we assign colors to 
the black and white picture. 

The proof that the backward black and white algorithm stops after a finite number of 
steps follows ideas presented in Bertein and Galves (1977) to study dual processes. Using 
these ideas we prove the existence of our process in a self-contained way. The same ideas 
appear again in the construction of the finitary coding. This type of construction is 
similar in spirit to procedures adopted in Ferrari (1990), Ferrari et al. (2002), Garcia and 
Marie (2006) and Van den Berg and Steif (1999). However all these papers only consider 
particular models, satisfying restrictive assumptions which are not assumed in the present 
paper. 

Our Theorem H] shows the existence of a finitary coding from an i.i.d. finite-valued process 
to the invariant probability measure of the multicolor system. This can be seen as an 
extension to the infinite range processes of Theorem 3.4 of Van den Berg and Steif (1999). 

Haggstrom and Steif (2000) constructs a finitary coding for Markov fields. This result 
follows, under slightly stronger assumptions, as a corollary of our Theorem H] which holds 
also for non Markov infinite range fields. These authors conclude the above mentioned 
paper by observing that the extension of their results to "infinite-range Gibbs measures 
appears to be a more difficult matter" . Our Theorem |4] is an attempt in this direction. 

This paper is organized as follows. In Section 2 we present the model and state a prelim- 
inary result, Theorem [TJ which gives the representation of the change rate as a countable 
mixture of local change rates. In Section 3, we present the perfect simulation algorithm 
and Theorem [2] which ensures that the algorithm stops after a finite number of steps. 
Theorem [2] also guarantees the exponential ergodicity of the process. The definitions 
and results concerning the finitary coding are presented in Section 4. The proofs of the 
theorems are presented in Sections 5 to 11. 

2 Definitions, notation and basic results 

In what follows, A will be a finite set of colors, the initial lowercase letters a, b, c, . . . will 
denote elements of A. We will call configuration any element of A z . Configurations will 
be denoted by letters rj, £, ... A point i G Z d will be called site. As usual, for any i G Z d , 
r)(i) will denote the value of the configuration rj at site i. By extension, for any subset 
V C Z d , 7i(V) 6 A v will denote the restriction of the configuration r\ to the set of positions 
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in V. For any 77, i and a, we shall denote rf ,a the modified configuration 

For any i G 77 E j4 zd and a £ A, c / 77(7), and we denote by q(o, 77) a positive real 
number. We suppose that there exists a constant Tj < +00 such that 

Ci(a,r))<Ti, (2.1) 

for every a and 77 such that a ^ 77(7). 

A multicolor system with interactions of infinite range is a Markov process on A^ d whose 
generator is defined on cylinder functions by 

Lf(ri) = Y. E *M\Jtf*)-M\- (2-2) 

Intuitively, this form of the generator means that the site i will be updated to the symbol 
a, a 7^ Tj(i), at a rate Cj(a, 77) whenever the configuration of the system is 77. The choice of 
Cj(a, 77) for a = 77(7) does not affect the generator (|2.2p and represents a degree of freedom 
in our model. In what follows we choose 0,(77(7), 77) in such a way that 

Ci (a, 77) = Mi Pi (a\rj). (2.3) 

In the above formula Mi < +00 is a suitable constant and for every fixed configuration 77, 
Pi(-\t]) is a probability measure on A. Condition (|2.1|) implies that such a choice is always 
possible, for instance by taking Mi = \A\ Tj and defining 

Q (77(7;), 77) =Mi- c i( a >v)- (2-4) 

We shall call (cj)j gZ d a family of rate functions for this fixed choice (|2.4H . 

Our first aim is to give sufficient conditions on Ci(a,rj) implying the existence of a perfect 
simulation algorithm of the process having generator (|2.2p . To state these conditions, we 
need some extra notation. Let V{(k) = {j G Z d ; < — i\\ < k}, where \\j\\ = Y2u=i U«l * s 
the usual Li-norm of Z d . We will impose the following continuity condition on the family 
of rate functions c. 

Continuity condition. For any symbol a, we will assume that 



sup sup \ci(a, 77) - Ci(a, C)| -> 0, (2.5) 

i&fi v(Vi(k))=C(Vi(k)) 



as k — > 00. 
Define 



ai(-l) = V^min inf a(a,(),Mi- sup V"cj(fc,C) , (2.6) 



and for any fc > 0, 



ai(/c) = min ( V" inf Ci(a,())+Mi- sup V" q(6, C) 

\ a(LA,a^w(i) ' * v ^ b=tw(t) 



(2.7) 
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In order to clarify the role of oti(k), we present an example that is a spatial version of the 
chain that regenerates in 1 : the evolution of a site depends on the random ball around 
that site where the size of this ball is the smallest radius such that 1 belongs to the ball 
(without the center itself). 

Example 1 Let A = {0, 1}, 

h(v) = h if max vU) = and max rj(j) = 1 

and define 

Ci(l,rf) = q h ^), Ci(0,rf) = 1 - q(1,t/), 
where < q^ < 1 for all k. 
Note that in this case, 

sup sup |ci(l, 77) -Cj(l,C)| = sup \qi-q m \, 

i »j(Vi(fc))=C(Vi(fc)) l,m>k 

and thus the process is continuous, if and only if lim^ g% exists. 
Observe that if qu { qoo, as k — > 00, then Mi = 1 and 

a»(-l) = min inf q(0,C), 1- sup q(1,C) 
\ceA^,at)=i (eAz d ,<;(i)=o J 

+ min inf Cj(l,C), 1- sup Cj(0,C) 

\(eA^ d ,ai)=o ceA% d ,c(i)=i / 

= inf Ci(0,C)+ mf Cj(l,C) 

(eA ld (eA ld 



Also, 



l-qo + q c 



Qj(0) = min( inf q(1,C) + 1- sup q(l,C), 

VeAz d ,c«=o (eA^ d ,((i)=o 

inf q(0,C) + 1 - sup Ci(0,C)) 

(eAz d ,<;(i)=i ceAz d ,t(i)=i J 

= min(goo + l-q ,l-q + q^) 

= Oi(-l). 



Finally, 



Oi(k) = min inf Cj(l - £(»), C) + 1 - sup Ci(C(i),C) 

L,gA^( fe ) \C-C(Vi(k))=W C . C( y.( fc )) =w 



M.'fc 



min inf Cj(0, () + inf Cj(l, £) 

^GA^W \C:C(Vj(fc))=i« C:C(Vi(fc))=to 



\C:C(Vi(fc))=w C=C(Vi(fc))=tu 
= (1 - <7fc) + <7oo- 



= mm 



4 



Let us introduce some more notation. Note that for each site i, 



Mi = lim ai(k). (2i 

k^oo 



Hence to each site i we can associate a probability distribution Aj by 



and for k > 



M-l) = (2.9) 



Hk) = a#) "^ (fc " 1} . (2.10) 



We will see that for each i the family of rate functions Cj(., .) can be represented as 
a mixture of local rate functions weighted by (Aj (&))&>_!. More formally, we have the 
following theorem. 



Theorem 1 Let ((H)ieZ d be a family of rate functions satisfying the conditions 12. 
\2.lj\) , the continuity condition \2. 5\) and the summability condition \3.13\) . Then for any 

site i there exists a family of conditional probabilities p\ on A depending on the local 
configurations r](Vi(k)) such that 

Ci(a,rj) = MiPi(a\n), where Pi(a\rj) = ^ Xi(k)pf\a\rj(Vi(k))). (2.11) 

fc>-i 

As a consequence, the infinitesimal generator L given by \2.2\) can be rewritten as 

L f(v) = E E E MMk)pf\a\r } {V i {k)))[f{rf' a ) ~ f(v)} ■ (2-12) 

iez d aeAk>-i 



Remark 1 Note that for k = —1, Vi{k) = and hence p\ (a\r](Vi(k))) = p\ (a) does 
not depend on the configuration. Therefore, Aj(— 1) represents the spontaneous self-coloring 
rate of site i in the process. 



The representation given by (12.120 provides a clearer description of the time evolution of 
the process. We start with an initial configuration n at time zero. This configuration is 
updated in a cadlag way as follows. For each site i € consider a rate Mi Poisson point 
process N l . The Poisson processes corresponding to distinct sites are all independent. If 
at time t, the Poisson clock associated to site i rings, we choose a range k with probability 
Xi(k) independently of everything else. And then, update the value of the configuration 

at this site by choosing a symbol a with probability pf\a\Q {Vi{k))) . 



3 Perfect simulation of the stationary process 

The decomposition (12. lip provided by Theorem Q] suggests an algorithm of perfect sim- 
ulation for the multicolor long range interacting system. This is the main result of this 
article. The goal is to sample under equilibrium the time evolution of any finite set of 
sites F during any fixed finite time interval. 
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We first introduce a simulation procedure to sample the time evolution of any finite set 
of sites F during any fixed finite time interval [0, t], when starting from a fixed initial 
configuration r/. This simulation procedure has two stages. First, we draw a backward 
black and white sketch in order to determine the set of sites and the succession of choices 
affecting the configuration of the set of sites F at time t. Then, in the second stage, a 
forward coloring procedure assigns colors to every site involved in the black and white 
sketch. This will be formally described in Algorithms 1 and 2 below. 

Let us describe the mathematical ideas behind this algorithm. Our goal is to simulate the 
configuration of the fixed set of sites F during the time interval [0, t] when the process 
starts from an initial configuration r\. We climb up the rate Mj Poisson processes A rJ , j € F, 
until we find the last occurrence time before time t where the Poisson clock rang. Note 
that the probability that the clock of site i rings first among all these clocks is given by 

Mj 

Then we have to inspect the configuration at the sites belonging to the finite set Vi(k) 
which is chosen at that time. Vi(k) is chosen with probability Xi(k),k > —1. If k = — 1 
is chosen, this means that the value of at that time is chosen according to p\ 1 ', 
independently of the other sites, and thus site i can be removed from the set F. 

Otherwise, if k > 0, we have to include all the sites in Vi(k) to the set of sites F and 
to continue the algorithm. The reverse-time checking continues for each point reached 
previously until we find an occurrence time before time 0. In this case the algorithm stops. 

In the second stage, the algorithm assigns colors to all the sites that have been involved 
in the first stage. To begin with, all sites that have not yet chosen a range —1, will be 
colored according to the initial configuration rj at time 0. And then successively, going 
forwards in time, we assign colors to the remaining sites according to pf\-\Vi(k)), where 
all sites in Vi(k) have already been colored in a previous step of the algorithm. Finally we 
finish with the colors of the set of sites F at time t. 

The finite time simulation Algorithm 1 and 2 uses the following variables. 

• N is an auxiliary variables taking values in the set of non- negative integers {0, 1,2,...} 

• Nstop is a counter taking values in the set of non-negative integers {0, 1, 2, . . .} 

• Tstop is an element of (0, +oo) 

• I is variable taking values in Z rf 

• K is a variable taking values in {—1,0, 1, . . .} 

• T is an element of (0, +oo) 

• B = (B 1 ,B 2 ,B 3 ) where 

- Bi is an array of elements of Z d 

- B2 is an array of elements of {—1, 0, 1, . . .} 

- B% is an array of elements of (0, +00) 
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• C is variable taking values in the set of finite subsets of Z d 

• W is an auxiliary variable taking values in A 

• V is an array of elements of A 

• C, is a function from Z d to A U {A}, where A is some extra symbol that does not 
belong to A 



Algorithm 1 Backward black and white sketch without deaths 
1: Input: F; Output: Nstop, B, C, Tstop 
2: TV <- 0, Nstop «- 0, B <- 0, C <- F, T S top <- 
3: while T STOP < t and C / do 

4: Choose a time T G (0, +oo) randomly according to the exponential distribution with 
parameter Yljec^j- Update 

Tstop <— T S top + T. 



5: iV^iV+1. 

6: Choose a site I & C randomly according to the distribution 



7: Choose K € { — 1,0,1,...} randomly according to the distribution 

P(K = k) = Aj(fc) 



8: C^CUVr^) 

9: 5(A0^(/,K, T S top) 
10: end while 

li: Nstop <- AT 



Using output V of Algorithm 2 and output -B of Algorithm 1 we can construct the time 
evolution (£ S (F),Q < s < t) of the process. This is done as follows. 

Denote I(N),T(N) the first and the third coordinate of the array B(N) respectively. 
Introduce the following random times for any 1 < n < Nstop, 

S n = t-T{N ST OP-n + l). 

• For < s < Si define = C(^). 

• For 1 < n < Nstop, for S n < s < S n+ i A t, we put 

- for all i e F such that i / I{N S top — n + 1), £ s (i) = £s n (i); 

- for i = I (Nstop - n + 1), &(t) = V(n). 

We summarize the above discussion in the following proposition. 
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Algorithm 2 Forward coloring procedure 



1: Input: Nstop, B, C, 77(C); Output: V 
2: N «- Nstop 

3: CO') <~ VU) for a11 J G CO') «- A for all j £Z d \C 

4: while iV > 1 do 

5: (I,K,T) ^B(N). 

6: if if = -1 then 

7: Choose W randomly in A according to the probability distribution 

P(W = v) =p [ f 1] {v) 

8: else 

9: Choose W randomly in A according to the probability distribution 

10: end if 

11: CCO *~ W 
12: V(N) *- W 
13: iV <- N - 1 

14: end while 



Proposition 1 Let (ci) ie %d be a family of continuous rate functions satisfying the condi- 
tions of TheoremUi If 

sup y2\Vi(k)\\i{k) < +00, (3.13) 
^ d k>0 

then Algorithm 1 stops almost surely after a finite number of steps, i.e. 

P {Nstop < +00) = 1. 

Moreover, for any initial configuration rj, there exists a unique Markov process (£^)t>o 
such that = 77 and with infinitesimal generator 

L f(v) = EEciMt/ft^Wfo)]. (3.14) 

The cylindrical time evolution (£ S (F),Q < s < t) simulated in Algorithms 1 and 2 is a 
sample from this process £p. 

We now turn to the main object of this paper, the perfect simulation of the multicolor 
long range interacting system under equilibrium. The goal is to sample under equilibrium 
the time evolution of any finite set of sites F during any fixed finite time interval. 

We first introduce a simulation procedure to sample from equilibrium the cylindrical con- 
figuration at a fixed time. As before, this simulation procedure has two stages : First, we 
draw a backward black and white sketch in order to determine the set of sites and the 
succession of choices affecting the configuration of the set of sites at equilibrium. Then, 
in the second stage, a forward coloring procedure assigns colors to every site involved in 
the black and white sketch. This will be formally described in Algorithms 3 and 4 below. 

The following variables will be used. 
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• N is an auxiliary variables taking values in the set of non- negative integers {0, 1,2,...} 

• Nstop is a counter taking values in the set of non-negative integers {0, 1, 2, . . .} 

• / is variable taking values in Z rf 

• K is a variable taking values in {— 1, 0, 1, . . .} 

• B is an array of elements of 7L d x {-1, 0, 1, . . .} 

• C is variable taking values in the set of finite subsets of Z rf 

• W is an auxiliary variable taking values in A 

• ■>] is a function from Z rf to A U {A}, where A is some extra symbol that does not 
belong to A 



Algorithm 3 Backward black and white sketch 
1: Input: F; Output: Nstop, B 
2: N <- 0, Nstop «- 0, B <- 0, C <- F, 
3: while C ^ do 

4: JV<-JV + 1. 

5: Choose a site I € C randomly according to the distribution 



P(I = i) = 




6: Choose K £ { — 1, 0, 1, . . .} randomly according to the distribution 

P(K = k) = Aj(fc) 



7 


if if = -1, then 


8 


C <- C \ {/} 


9 


else 


10 


C CU Vz-(if) 


11 


end if 


12 


B(N)^(I,K) 


13 


end while 


14 


Nstop ^ 



Let us call the distribution on A z whose projection on A F is the law of rj(F) printed at 
the end of Algorithm 4. The following theorem gives a sufficient condition ensuring that 
Algorithm 3 stops after a finite number of steps and shows that // is actually the invariant 
measure of the process. 

Theorem 2 Let (cj)j gZ d be a family of rate functions satisfying the conditions of Theorem 

m if 

sup V \Vi(k)\Xi(k) < 1, (3.15) 
^ d k>0 
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Algorithm 4 Forward coloring procedure 



1: Input: NstoPi B; Output: {(i,r)(i)),i £ F} 

2: N <— Nstop 

3: rj(j) <- A for all j G Z d 

4: while iV > 1 do 

5: (I,K)<-B(N). 

6: if if = -1 then 

7: Choose randomly in A according to the probability distribution 

P(W = v) =p [ f 1] {v) 

8: else 

9: Choose W randomly in A according to the probability distribution 

P(W = v)= pf^vl^V^K)) 

10: end if 

11: r]{I) «- W 

12: N <— N — 1 

13: end while 



then 

P {Nstop < +oo) = 1. 

The law of the set {(i,T](i)) : i £ F} printed at the end of Algorithms 3 and 4 is the 
projection on A F of the unique invariant probability measure \i of the process. Moreover, 
the law of the process starting from any initial configuration converges weakly to fj, and 
this convergence takes place exponentially fast. 

Remark 2 In the literature, we say that the process is ergodic, if it admits a unique 
invariant measure which is the weak limit of the law of the process starting from any 
initial configuration. If this convergence takes place exponentially fast, we say that the 
process is exponentially ergodic. Therefore, Theorem says that the multicolor system is 
exponentially ergodic. 

Algorithms 3 and 4 show how to sample the invariant probability measure of the process. 
We now pursuit a more ambitious goal : how to sample the stationary time evolution of 
any fixed finite set of sites F during any fixed interval of time [0, t] . This is done using 
Algorithms 1 and 2 as well. 

Algorithm 1 produces a backward black and white sketch without removing the sponta- 
neously coloring sites. We start at time t with the set of sites F and run backward in time 
until time 0. This produces as part of its output the set of sites C whose coloring at time 
will affect the coloring of the sites in F during [0, t] . We then use the output set C of 
Algorithm 1 as input set of positions in Algorithms 3 and 4. Algorithms 3 and 4 will give 
us as output the configuration 77(C) that will be used as input configuration for Algorithm 
2. 
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Theorem 3 Under the conditions of Theorem^ Algorithm 3 stops almost surely after a 
finite number of steps 

P{N S top < +00) = 1. 

Moreover, under the conditions of Theorem^ for any t > 0, the cylindrical time evolution 
(Cs(^ ? ))0 < s < t) simulated in Algorithms 1, 2, 3 and 4 is a sample from the stationary 
process. 

4 Finitary coding 

The perfect simulation procedure described in Algorithms 1-4 gives the basis for the con- 
struction a finitary coding for the invariant probability measure of the multicolor system 
£t- By this we mean the following. Let (Y(i),i G Z d ) be a family of i.i.d. random vari- 
ables assuming values on a finite set 5. Let (£o(i),i G Z d ) be the configuration sampled 
according to the invariant probability measure \i obtained as output of Algorithm 2. 

Definition 1 We say that there exists a finitary coding from (Y(i),i G Z d ) to (£o(i),i G 
lj d ) if there exists a deterministic function f : S zd — > A zd such that almost surely the 
following holds: 

• / commutes with the shift operator, that is, /(TJ(y)) = Tj(/(y)) for any i G Z d ; 

• Zo = f((Y(j)),jeZ d ); and 

• there exists a a finite subset F of Z d satisfying 

f((YU)),jez d ) = f({Y'U)), 3 ez d ) 

whenever 

Y'(j) = Y(j) for alljeF. 

In the first condition of the definition, the notation Tj denotes the translation by i steps, 
in S^ d , or in A zd . More precisely, for any i G Z d , if y G S zd then Tj(y) is the element of 
S zd such that Ti(y)(j) = y(j — i) with equivalent definition for £ G A^ d . 

Theorem 4 Under the conditions of Theorem there exists a finitary coding from an 
independent and identically distributed family of finite-valued variables (Y(i),i G Z d ) to 
(£ (i),iGZ d ). 

Theorem 1.1 of Haggstrom and Steif (2000) follows as a corollary of Theorem [5] under 
a slightly stronger condition. In order to state this corollary, we need to introduce the 
notion of Markov random field. 

Definition 2 A Markov random field X on Z d with values in a finite alphabet A has 
distribution n if [x admits a consistent set of conditional probabilities 

KX(A) = £(A)|X(Z d \ A) = i(Z d \ A)) = M (X(A) = £(A)|X(3A) = £(5A)) 

for all finite A C 7L d , £ G A zd . Here, dA = {j G Z d : inf ie A ||« - ill = !}• Such a set of 
conditional probabilities is called the specification of the random field and denoted by Q. 
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Corollary 1 For any Markov random field X on Z, d with specification Q satisfying 

2d 

£ C(S» Q(X(0) = a|X(a0) = C(a0)) > 2d+l ' (416) 

i/iere exists an i.i.d. sequence (Y(i),i G Z d ) of finite valued random variables such that 
there exists a finitary coding from (Y(i),i € Z d ) to the Markov random field. 

Remark 3 Just for comparison, Condition fijjjjty is equivalent to 

2d 



<*o(-l) > 



2d + l' 



w//n/e Condition HN in Theorem 1.1 of Haggstrom and Steif (2000) can be rewritten in 
our notation as 

This does not seem to be a too high price to pay in order to be able to treat the general 
case of long range interactions. 



5 Proof of Theorem [T] 

The countable mixture representation provided by Theorem Q] is the basis of all the other 
results presented in this paper. Therefore it is just fair that its proof appears in the first 
place. 

Recall that Cj(a,r/) = MiPi(a\r]). Therefore, it is sufficient to provide a decomposition for 
Pi(a\rj). Put 

r i ( a ) = infpiWC), 

A!" 11 (a) = rj" 1] (a), 
rfVfoO^O))) = inf Pi (a|C), 

C:Cfl*(0))=i7(VS(0)) 



For any k > 1, define 



rl k] (a\n(Vi(k))) = inf Pi(a\(), 



Af 1 (a|r ? (^(A;))) = r| fcI (o|^(^(A;))) - rf~ l] (n^V^k - 1))). 
Then we have that 

k 

vMn) = ^ ] (a\v(Vi(j))) + \pM\n) -r^{a\n(Vi{k))) 
i=-i 

By continuity of Ci(a,rj), hence of Pi(a\rj), 

rf\a\rj(Vi(k))) — » Pi(a\rj) as k — > oo. 
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Hence by monotone convergence, we conclude that 

oo 

A?(a\i 1 (V i (j)))=Ma\v)- 

i=-i 

Now, put 

a 

and for any i,k such that Xi(k,rj(Vi(k))) > 0, we define 

\k] 

For i.jfe such that Xi(k,ri(Vi(k))) = 0, define Pi (a\rf(Vi(k))) in an arbitrary fixed way. 
Hence 

oo 

Pl (a\ v ) = £ Aj(A;,r;(Vi(A;)))pf (a^T^A;))). (5.17) 
fc=-i 

In (|5.17p the factors Xi(k,n(Vi(k))) still depend on r/(Vi(A;)). To obtain the decomposition 
as in the theorem, we must rewrite it as follows. 

For any i, take Mj as in (|2.8j) and the sequences oti(k), Xi(k), k > —1, as defined in <\2.7\) 
and (|2.10p . respectively. Define the new quantities 

oii(k, r)(Vi(k))) = Mi ^Xi(l, V (Vi(l)))- 

l<k 

Finally put p\ l \a) = p\ ^(a), and for any k > 0, 

k-l 

^2 1 {a l (l'-lMV t (l'-l)))<a 1 (k-l)<a t (l'MV l (l')))} l {a 1 (lMV t (l)))^^ 
-l=l'<l 

m=l'+l 1 n J 



+ ttl( * ) "^) (Vi( "'M ' +11 (.i.»w«+i))) 

This concludes our proof. □ 



6 The black and white time-reverse sketch process 

The black and white time-reverse sketch process gives the mathematically precise descrip- 
tion of the backward black and white Algorithm 1 given above. We start by introducing 
some more notation. For each i 6 Z rf , denote by . . . Tl 2 < T % _ x < Tq < < T\ < T\ < ■ ■ ■ 
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the occurrence times of the rate Mj Poisson point process N % on the real line. The Poisson 
point processes associated to different sites are independent. To each point associate 
an independent mark K l n according to the probability distribution (\i(k))k>~i- As usual, 
we identify the Poisson point processes and the counting measures through the formula 



N*[s,t] = £l {s <T*< t} - 



It follows from this identification that for any t > we have T^^^ <t< ^jv»(ot]+i' anc ^ 
for any t < 0, Tj_ Nim < t < Tl Nim+v 

For each i G 7L d and t G R we define the time-reverse point process starting at time t, 
associated to site i, 

± n — 1 1 W*(0,t]-ra+l' L — u ' 

f(^) = t - Tl^o].^, t<0. (6.18) 
We also define the associated marks 

Kt ] = ^ Nim _ n+V t>0, 

= Ki Nim _ n+1 , t<0. (6.19) 

For each site i G Z d , k > —1, the reversed /c-marked Poisson point process returning from 
time t is defined as 

n(^%,u] = EW 4) <«}V^=*r (6 - 20) 

n 

To define the black and white time-reverse sketch process we need to introduce a family 
of transformations {ir^ l ' k \i G Z d , k > 0} on the set of finite subsets of Z d , ^(Z d ), defined 
as follows. For any unitary set {j}, 

*»W> - { M 

Notice that for = —1, TT^' k \{i}) = 0. For any set finite set F C Z d , we define similarly 

^• fe )(F) = U jeF ^ k \{j}). (6.22) 

The black and white time-reverse sketch process starting at site i at time t will be denoted 
by (C , | l ' < ' ) ) s >o. cf'^ is the set of sites at time s whose colors affect the color of site i at time 
t. The evolution of this process is defined through the following equation: C^'^ := {i}, 
and 

f(CM) = f{C { ^) + £ E j\f{^ k \C^ ) ))-f{C^)]N^ k \du), (6.23) 

k>-ijez d 

where / : JF(Z d ) — > 1R is any bounded cylindrical function. This family of equations 
characterizes completely the time evolution {ci*'*\s > 0}. For any finite set F a 7L d 
define 

The following proposition summarizes the properties of the family of processes defined 
above. 
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Proposition 2 For any finite set F C Z d , C$ is a Markov jump process having as 
infinitesimal generator 

L f( C ) = EE A *( A; )[/( CU ^( A; ))-/( C7 )] + Ai(-1)[/(C\W)-/(C)], (6.24) 

iec* fc>o 

where f is any bounded function. 

Proof: The proof follows in a standard way from the construction (|6.23p . 



7 Proof of Theorem [T] 

The existence issue addressed by Theorem [1] can be reformulated in terms of the black and 
white time-reverse sketch process described above. The process is well defined if for each 
site i and each time t, the time-reverse procedure C^'*' described above is a non-explosive 
Markov jump process. This means that for each time t, the number of operations needed 
to determine the value of Q(i) is finite almost surely. Note that by equation (|6.23p . the 
jumps of C^'*) occur at total rate 



Y, Mj Y \ 3 (k)< (sup M 3 )\C^ 



'■) 



jeC (i,t) k>-i 

where | • | denotes the cardinal of a set. Hence it suffices to show that the cardinal of C^'*' 
remains finite. 

(it) i 

More precisely, fix some N E N. Let L s = \C S ' | and 

T N = M{t : L t > N}. 

Then by (|fT23jh 

rsAT N 

l SATn < i+EE/ [1^(^)1 -i]i { . 6cCM)} iv^ fe )(^) 

k>ijez d 

-E / h jeC ^ } N Um (du). (7.25) 



o 



Passing to expectation and using that by condition f)3. 13|) . 

supJ^M Xi(k)\Vi{k)\ < +oo, 



m 



this yields 



e(l SATn ) < i+Y M i (Emaoo^wi-id-m-i) 

j& d y k>i 

psAT n 

XE J \^ } du 

rsAT N 

< 1 + mE L u du. (7.26) 

Jo 
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Letting N — > oo, we thus get that 

< 1 + m / E(L u )du, 
Jo 

and Gronwall's lemma yields 

£(L S ) < e ms . (7.27) 

This implies that the number of sites that have to be determined in order to know the 
value of site i at time t is finite almost surely. This means that the process Cs ' admits 
only a finite number of jumps on any finite time interval. Hence, we have necessarily 
Nstop < +°° almost surely which means that the algorithm stops almost surely after a 
finite time. This concludes the proof of Theorem [TJ 



8 Proof of Theorem [2] 

We show that under condition (|3.15p . Algorithm 3 stops after a finite time almost surely. 
Write L\ for the cardinal of C^'^ . Using once more the upper-bound (|7,26p and the fact 
that under condition (|3.15p . 



Mj ((£ XjikWmi - 1]) - A,(-1)J < -e < 0, 
Gronwall's lemma yields that 

E{L\) < 

Hence, since \Cp ] \ < |d M) | = £ i6F 4, 

E(\C^\) < \F\e- £S - 

This implies that inf{s : ci F '^ = 0} is finite almost surely. Due to Theorem [TJ the process 
(F t) 

C s is non-explosive, which means that it admits only a finite number of jumps on any 
finite time interval. Hence, we have necessarily Nstop < +°° almost surely which means 
that the algorithm stops almost surely after a finite time. 

In order to show that the measure fi that we have simulated in this way is necessarily the 
unique invariant probability measure of the process, we prove the following lemma. 

Lemma 1 Fix a time t > 0, some finite set of sites F C Z d and two initial configurations 
7] and C S A zd . Then there exists a coupling of the two processes (^s)s and (£s)s such that 

P(^(F)^^(F))<\F\e- £t . 

From this lemma, it follows immediately that \x is the unique invariant measure of the 
process and that the convergence towards the invariant measure takes place exponentially 
fast. 

Proof of Lemma [TJ We use a slight modification of Algorithm 1 and 2 in order to 
construct Q and The modification is defined as follows. Replace step 8 of Algorithm 
1 by 

if K = -1, then 
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C <- C \ {/} 
else 

We use the same realizations of T, I and K for the construction of and Write L s for 
the cardinal of Cg . Clearly, both realizations of Q and ^ do not depend on the initial 
configuration rj, ( respectively if and only if the output C of Algorithm 1 is void. Thus, 

P($(F)^£(F)) < P{T S TOP>t) 

= P(Lt>l) 

< E(L t ) < \F\e" et . 

This concludes the proof of lemma [TJ 

9 Proof of Theorem [3] 

The proof of Theorem [3] goes according to the following lines. 

We start at time t with the sites in F and go back into the past until time following 
the backward black and white sketch without deaths described in Algorithm 1. The set 
C of points reached by this procedure at time are the only ones which coloring affects 
the evolution during the interval of time [0, t] of the sites belonging to F. 

We need to know that C is a finite set. This follows from a slight modification of the 
proof of Theorem [TJ Notice that in the construction by Algorithm 1, even if K = — 1, the 
corresponding site is not removed from the set C. This implies that in the upper bound 
(|7.25p the negative term on the right hand side disappears. This modification does not 
affect the upper bound (|7.26|) which remains true. 

Using Theorem [2] we assign colors to the sites belonging to C using the invariant distri- 
bution at the origin of the multicolor system. Then we apply Algorithm 2 to describe the 
time evolution of the coloring of the sites in F. This evolution depends on the colors of 
the sites in C at time zero as well as on the successive choices of sites and ranges made 
during the backward steps starting at time t. This concludes the proof. 

10 Proof of Theorem [4] 

The construction of the finitary coding can be better understood if we do it using two 
intermediate steps based on families of infinite-valued random variables. 

Using a slightly abusive terminology, let us introduce the following definitions of a finitary 
coding from families of piles of i.i.d. random variables. 

Definition 3 We say that there exists a finitary coding from a family of i.i.d. uniform 
random variables (U n (i),i £ Z, d ,n G N) to the configuration (£o(*)>* £ sampled with 
respect to the invariant probability measure fj,, if there exists a deterministic function 
f : [0, l] zdxN — > A^ d such that, almost surely, the following holds 

• / commutes with the shift operator in % d ; 
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• £o = f((U n (j)),j eZ d ,n£N); and 

• for each site i E Z d , there exists a a finite subset F of Z d and raj > 1 smc/i i/iat if 

Unti) = U nU) for all j G Fi,n<n\i 

then 

f((U n (j))J G Z d ,n G N)(i) = f((K(j))J G Z d ,n G N)(f). 

Definition 4 VFe say t/iai f/iene exists a finitary coding from a family of i.i.d. fair 
Bernoulli random variables (Y nr (i),i G Z d , (n,r) G N 2 ) to i/ie configuration (£o(*)?* G 
sampled with respect to the invariant probability measure fi, if there exists a deterministic 
function f : {0, 1} Z xN — > A z such that, almost surely, the following holds 

• / commutes with the shift operator in % d ; 

• £o = f((Y n , r (j)),j G (n,r) G N 2 ); and 

• for each site i G "L d , there exists a a finite subset F of Z rf and fi{ > 1 such that if 

Y^ r (j) = Y n!r (j) for all j G F h \ < n < n u l < r < n, t 

then 

f((Y n , r (j)),j G Z d ,(n,r) G N 2 )(i) = f((Y^ r (j)),j G Z d ,(n,r) G N 2 )(i). 

We will first prove the existence of a finitary coding in this extended definition from the 
sequence (U n (i),i G 7, d ,n G N) to the configuration (£o(i),i G Z, d ) . 

Proposition 3 Under the conditions of Theorem 0, there exists a finitary coding from 
a family of i.i.d. uniform random variables (U n (i),i G Z d ,n G N) to the configuration 
(Co(i),iGZ d ). 

Proof Our goal is to choose the color of site i at time using Algorithms 3 and 4. For 
notational convenience, we will represent the sequence U n (j) as 

K(j),veV, 

where V = {I,K,W}. 

The first sequence of uniform variables U^(j) is used for the choice of successive points 
I at Step 5 of Algorithm 3. The second sequence U^{j) will be used to construct the 
sequence of ranges K of Step 6 of Algorithm 4. Finally, the third sequence U^(j) will be 
used to construct the corresponding colors W at Steps 7 and 9 of the forward procedure 
described in Algorithm 4. 

The fact that N$top is finite almost surely implies that the backward Algorithm 1 must 
run only a finite number of steps for any fixed i. Thus only a finite set of sites F\ is 
involved in this procedure. This also implies that the number of uniform random variables 
we must use is finite, thus is finite. The definition of the function / is explicitly given 
by Algorithms 3 and 4. 

This concludes the proof of Proposition [3l 

Proposition [3] can be rewritten using piles of piles of Bernoulli random variables instead 
of piles of uniform random variables. 



18 



Proposition 4 Under the conditions of Theorem rjl there exists a finitary coding from 
a family of i.i.d. fair Bernoulli random variables (Y n ^ r (i),i G Z d ,(n,r) G N 2 ) to the 
configuration (£,o(i),i G 7L d ). 

Proof As before, for notional convenience, we will represent the sequence Y nr (j) as 

Y^ r (j), v G V. 

All we need to prove is that the successive uniform random variables {U%(j),j G Fi, 1 < 
n < Hi} used in Proposition [3] can be generated using a finite number of Bernoulli random 
variables from the pile Y^ r (j),r G N. 

In all the steps, the uniform random variables were used to generate random variables 
taking values in a countable set. Let us identify this countable set with N. In the successive 
steps of Algorithms 3 and 4, this selection could generate either K, I or W. The selection 
is made by defining in each case a suitable partition of [0, 1] = [#(/), 9(1 + 1)) and then 
choosing the index I whenever U%(j) G [9(1), 6(1 + 1)). It is easy to see that U%(j) has the 
same law as Yl^Li ^~ r ^n,r(j)- 

We borrow from Knuth and Yao (1976) the following algorithm to generate the discrete 
random variables /, K and W which appear in the perfect sampling procedure (see also 
Harvey et al, 2005). For any m > 1, we define 

m 

S m (j,n,v)=Y,2-~ r Yn,rti)- 

r=l 

Now, put 

J(S m (j,n,v)) = sup{k > 1 : 6(k) < S m (j,n,v)}, 

and finally define 

N%(j) = inf{m > 1 : J(S m (j,n,v)) = J(S m ,(j,n,v))Vm' > m}. (10.28) 

Notice that N%(j) is a finite stopping time with respect to the cr-algebra generated 
by {%Tr(i)' r — !}• Therefore, the total number of piles N(j) is equal to N(j) = 
Ei)6vSn=i^n(i)' where fij is defined in Proposition [3l used at site j is finite and the 
event [N(j) = £} is measurable with respect to the cr-algebra generated by {Y^ r (j),v G 
V, 1 < n < £, 1 < r < £}. Since the set of sites used is Fi (the same one as Proposition [3]), 
the proof is complete. 

We are finally ready to prove Theorem [H The difficulty is to show that the construction 
achieved in Proposition fusing the random sized piles (Y^ r (i),v G V, i G Z d , n < N(i),r < 
N(i)) can actually be done using finite piles of fair Bernoulli random variables. Specifically, 
for i G Z d , let us call 

Z(i) = (Yl r (i),v G V, n G {0, . . . , M}, r G {0, . . . , M}), 

where M is a suitable fixed positive integer. 

The proof that there exists a finitary coding from the family of finite- valued i.i.d. random 
variables {Z(i),i G to {£,o(i),i G Z, d } follows from the construction in Van den Berg 
and Steif (1999) if we can take 

M > supE[JV(7*)]. 
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It follows from the definition of N%(J) given by (|1U,28|) that 



P[K(J') > k] < P U 



" ^ < S k (j,n,v) < 6(i) ) + P (i - ^ < SfcO>>«) < l) 

(10.29) 



where 



m k = sup{i > 1; 0(i) < 1 - -p}. 



In the above formula, the partition of [0, 1] = U^. 1 [0(z), 0(i + 1)) was used to simulate the 
count able- valued random variable at stake at that level (either /, K or W). 

Since Sk(j,n,v) converges in law to a uniform random variable as k — > oo, the right hand 
side of (|10.29p is bounded above by 

m k + 1 
2 k-i ■ 

For piles choosing colors, the result is obvious since the set of possible colors is finite and 
therefore all the corresponding = \A\ for all k > \A\. 

For piles choosing sites in the backward black and white sketch, the result follows from 
inequality (|7.27j) as in the conclusion of the proof of Proposition [TJ 

Finally, for piles choosing ranges, the result follows from the following two lemmas and 
Wald's inequality observing that fij < Nstop- 

Lemma 2 swpjE[N*f(j)] < oo. 

Proof It follows from Knuth and Yao (1976) that 



where H({\j(k)} k >-i) is the entropy of the discrete distribution {Aj (£;)}&>_! of the ran- 
dom variable K. On the other hand, the condition Y^k \Vk(j)\^k(j) < 1 in Theorem [2] 
implies that ^2 k k\j(k) = rrij < 1 for all j E 2, d . We want to compare {\j(k)} k >-i to a 
geometric distribution. For that sake, we introduce a distribution Vj{k) on {1,2, . . .} by 
Vj(k) = Xj(k - 2). Then 



By a direct comparison with the geometric distribution of mean fhj we have that 



where pj = 1/ (rhj ) . 
Lemma 3 ~E[Nstop] < 00 • 

Proof Without loss of generality we can consider F = {0} to start Algorithm 3. Define 



E[N«(j)] <H({X j (k)} k >. 1 ) + 2, 



(10.30) 




H({\j{k)} k >-x) < - log(pj) - log(l -Pj)(rhj - 1) < oo, 



(10.31) 



L n '•— \Ci 
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the cardinal of the set C n after n steps of Algorithm 3. Let (K % n ) n>0 igZd be the i.i.d. 
marks defined in Section [6J taking values in {—1,0, 1,2,...} such that 

P(K = k) = Aj(fc). 

Define X l n = \V (K l n )\ - 1. Note that by condition ([515]) . 

sup£(A^) < (A - 1) < 0, 

iez d 

where A = sup ieZ d Y^ k >o \Vi(k)\Xi(k). 

Consider the sequence I n which gives the site of the particle chosen at the nth step of 
Algorithm 3. Put 

n 

s n = XX* ■ 

k=0 

Note that by construction, S n + n(l — A) is a super-martingale. Then a very rough upper 
bound is 

L n <\ + S n as long as n < Vstop, 

where Vstop is defined as 

Vstop = min{/c : S k = -1}. 

By construction 

Nstop < Vstop- 

Fix a truncation level N. Then by the stopping rule for super-martingales, we have that 

E(S VsTOpAN ) + (1 - X)E(V S top A N) < 0. 

But notice that 

E(S VsTOpAN ) = -1 • P(V STO p <N)+ E{S N ; V S top > N). 

On Vstop > N, S N > 0, hence we have that E(S VsTOpAN ) > -P(V S top < N). We 
conclude that 

E(V ST op/\N) < —l^-PtVsTOP^N). 
[I - A) 

Now, letting — > oo, we get 

E(Vstop) < 



(1-A)' 
and therefore 

E(Nstop) < jz tt- 

(1 - AJ 



Finally for piles choosing sites in the backward black and white sketch, the result follows 
from inequality (17.271) as in the conclusion of the proof of Theorem [TJ 

This concludes the proof. 
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11 Proof of Corollary [T] 



The strategy of the proof is the following. We will consider a multicolor system having 
the law of the Markov random field as invariant measure. Then the corollary follows from 
the second assertion of Theorem 3J 

A standard way to obtain a system having the law /i as invariant measure is to ask 
for reversibility. Usually, in the statistics literature such dynamic is known as Gibbs 
sampler. In the statistical physics literature, where it first appeared, it is known as 
Glauber dynamics. We will use a particular case of the Glauber dynamics called the 
heat bath algorithm. The idea is that at each site there is a Poisson clock which rings 
independently of all other sites. Each time its clock rings the color of the site is updated 
according to the specification of the Markov random field Q. 

We are only considering the Markov spatially homogeneous case. This means that the rate 
Ci(a,Ti£) = co(a,£) where = £(j — i). co(a,£) only depends on £(<90). Moreover, 

in this case M = Mi = 1. 

With the heat bath algorithm, the rates are defined as 

c (a,0 = Q(X(0) = a\X(80) = £(80)) 
where Q is the specification of the random field X. 

Since we are considering the homogeneous case, we will drop the subscript from the nota- 
tion. Therefore, we have 

a(-l) = ^min inf co(a,(),l- sup ^c (6,C) 

a&A \C<^ Z C&A^,Cii)=a h ^ a 

= VVin inf c (a,(), inf c (a,C) 

= V min Q(X(Q) = a\X(dQ) = ((d0)). 



Also, 



a(0) = mm Y] inf c (a,C) + l- sup V"c (6,C) 

= min > inf cn(a,C) 
aeA w 

= minV inf Q(X(0) = a\X(dO) = ((80)) 
= E min S(X(0) = a|X(aO)=C(^0)). 

The last equality follows from the fact that inf^.^( )=iu Q(X(0) = a\X(dO) = ((dO)) only 
depends on the value of the random field at 90. 
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Finally, for all k > 1 



a(k) = min V inf c (a, + 1- sup V c (6,C) 



mm 



n inf c (a, () 

= min | V Q(X(0) = a|X(dO) = w(dO) ] = 1. 
wGAd ° J 

Observe that a(0) = a{— 1). Therefore, condition (|3.13|) reduces to 

, , 2d 

a -1 > . 

v 7 2d + 1 
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